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chapter - I. 


INTRODUCTION 


Pi* SOURCE AND STATEMENT OF THE 
proIlSm ““ 

P" yerytlfttQ at th© tlnis of ©xaminatlons, th© 
problem of cheating in examination-halls pinches us, 
but no practicable solution to this problem has been 
found so far. 

A few years back Dr, Harper^ suggested a 
remedy for the mass-copying« But then no remedy was 
suggested for copying from books and note-books etc* 
From this the Idea of open-book examination occurred 
to the investigator* But about the open-book examina¬ 
tions certain doubts were expressed. The present study 


1. Harper, A,Bdwln-Jr,, Mass Copying- A Remedy, 
Teacher Education, IV-1, Jan.,I960, pp.37-38. 
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ls based on these doubts expressed by teachers and others 
about the open book-examination. These vrere : 

1. Do all the students score uniformly high 
marks on different objectives in open-book 
examination ? 

2. Do the students with varying levels of 
achievement perform differently on different 
objectives in open-book examination ? 

3. Do the questions based on different objectives, 
namely, knowledge. Understanding and Appli¬ 
cation, discriminate Igetween high and low 
achievers ? 

4. If so, do the questions based on different 
objectives discriminate equally or different 
objectives discriminate differently ? and 

5. If the different objectives discriminate 
differently, which objective is most discrimi¬ 
native 7 

The present study Is, therefore undertaken to 
find the answers to these doubts expressed by teachers and 
others. 

SCOPE AND DELIMITATIONI OF THB STUDY . 


If open-book examinations are really very useful, 
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why are they then not Introduced ? It Is, probably because 
substantial research evidences on the open-book examina¬ 
tions are not available to support their Introduction In 
regular routine manner. They will, therefore need to 
stand some tests the first one probably will be their 
power to discriminate between high and low achievers. If 
the conclusion of the investigator would reveal that 
they do so educators will not hesitate accepting, advoca¬ 
ting and implementing them. 

In fact this study could be made on different 
objectives in different subjects and in different classes. 
But because of the limitation of the time factor, the 
study is conducted only on the students of science group 
studying in Class X of Delhi Board In three different 
schools, and only one question paper of Mathematlcs-B 
(Geometry) on the syllabus for class Ix was administered. 
Hence It is better not to generalise these results for 
other subjects and for other classes. 

The present study covers only the three 
objectives of cognitive domain, namely, Knowledge, Under¬ 
standing and implication. The same study can also be 

made on other objectives, e.g, those as propounded by 
2 

Bloom • 

2, Bloom, Benjamin S.^Ed.), Taxonomy of Educational 
Objectives , Hand-book I : ^gnltlve doiflafn, New lorki 
David McKay Co, Inc, 1966. 





C. RBVM OF RELATED LIXBRAlUHSj 


3 

In one stvidy Stalnakers epllt the final 
examination Into a three-hour morning open-hook aesslon 
and a three-hour after-noon closed-hook session and 
compared the relative standing of the students of the two 
types of examinations. In general they found 

■* .••• the relative standing did not change 
and that both types of examinations gave 

\ 

results similarly related to the scores on an 

Intelligence test. This means that the open- 

book gave neither more nor less advantage to 

the more intelligent student than did the 

4 

closed-hook examination." 

This shows that the questions set for both the 
question-papers tested the same abilities other than 
memory to a great extent. These findings further suggest 
that relative standing on these two tests did not differ 
much and this does not discourage the Idea of adopting 
the system of open-book examinatilon. 

3. Stalnakerj John M. and Stalnaker, Ruth C., " Open 

Book Examinations: Result", Journal of Higher Education , 
1936, 6, pp. 214-216 (noted from fieference 4 belowT^ 

4. Remmers, and Gag®, N.L-, Edueatlona 1 Measurement 

and Evaluation . New York: Harper and Brothers, 

Revised Edition, 1955, p. 557. 
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to certain students than to others, and the 

belief that there is no difference between the 

6 

types of examinations is of dubious nature,'* 

He further discovered that there is no difference 
in number of errors on the open-book examination between 
groups of students who rate open-book examinations as 
being helpful and those wlio rate them as being not help¬ 
ful, He also concluded that 

II.the two types of examinations measure 

significantly different abilities."'^ 

8 

fussing concluded in favour of open-book exami¬ 
nations# Feldhusen also evaluated the college students* 
reactions to open-book examinations and found it favouring 
the open-book examination at a very high level of 
significance. 




9# IbId, p. 203. 

7. Ibid, p. 203 

8. fussing, Lyle., A Consideration of the Open-Book 
Examination, Mueatlonal and Psychological Measurement 
11, 4, 1961, pp. ^97-^02. 

9. Feldhusen, John F., An Evaluation of College Students* 
Reactions to Open^Book Examinations, Bducstional and 

Psychological Measurement , 21, 3, ppT'S37^557“ 





CHAPTER II. 


m e thodolo gy m procedure- 


A, DESCR IPTIOH OF ;iHS EXPSHIMT- 


7^A/ present study is designed to study 

the differential performance of the pupils of upper and 
lower group on the questions based on the objectives of 
knowledge, understanding and Application in an open-book 
examination, and thus to find the questions based on 
which objective are most discriminative in an open-book 
examination- The objective is to find that the questions 
based on which objective should be set in the open-book 
examlnations- 

B- HYPOTHESES 

The null hypotheses for the said study may be 
stated as under : 

1* In an open-book examination the mean scores 
of pipilB on different objectives (namely, Knowledge, 
Understanding and Application) are equal, 
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* 

Syrabollcallyj 
= Mu = Ma 

2 m In an open-book examination the mean scores 
of high group, middle group and low group on questions 
based on the objective of Knowledge, Understanding and 
Application are equal 


symbolically, 



II 

U 

Mlk > 


II 

f 

II 

Mlu . 

and 

P 

I 1 

P 

1 1 

Mia . 

and 


lb 


3. In an open-book examination, questions testing 
different objectives discriminate equally between high 
and low acMevers, 

symbolically, 

i^hk - Mile : Mhu - - %a " ^la 

c. sample 

1. The subjects of this experiment were students 
who passed class IX examination of their schools in the 
year 1967 and were at present studying in Class X of the 
same school* 


* For key to different abbreviations and syrdbols see 
Appendix-^. 
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2. The school achievement of all the pupils of 
three different schools of i^ew Delhi studying In Science 
group of Glass X was recorded, 

3. The school achievement was based on only three 
different school tests, namely, 

£a) Half-yearly Examination of Class IX, Dec. 

1966; 

Cb) Annual Examination of Class IX, April 1967, 
and 

(c) Half Yearly Examination of Class X, December 
1967. 

4. The school achievement was based on the paper 
MathematIcs-B (that Is, Geometry) only. 

5. The open-book test was conducted on all these 

pupils. 

6. In all there were only ISO such pupils whose 
all the required records (l.e., scores on the three school 
tests and the scores on the open-book test) was available. 

7. Out of these first fifty pupils in order of 
merit formed the upper group, and the last fifty pupils 
in order of merit formed the lower group. 

D. COLLECTION OF DATA ; 

1. Tools used for the collection of Data 

For the collection of data the following two tools 
were used, namely, 

(a) The school Achievement; and 




£b) Scores of the Open-Book Test, constructed 
and administered by the investigator. 

2. Description of the Tools : 

The tools are described briefly in the following 

lines : 

Ca) TBS SCHOOL ACHIfiVJil®NT: 

The scores of pupils of these three schools (see 
Appendlx-B) in three different school tests in Geometry 
were collected and converted into the standard scores (z- 
scores). The standard scores of these three tests were 
combined to form the composite z-scores and on the basis 
of these composite z-scores actl the pupils of the three 
schools were thus ranked in order of their achlevegient. 

The first fifty out of 180 pupils (27.77^^) formed the 
*upper' group (H group)and the last fifty pupils formed 
the > lower* group (*L* group). 

(b) THE OPEN-BOOK TEST: 

The other tool used for the purpose was the 
question-paper to be administered with books and notes 
etc. permitted to be used by the examinees in the examina¬ 
tion-hall. It consisted of two parts. The form of the 
questions in Part-I was multiple-choice and in Part-II 
was short-answer. The number of questions testing different 
objeetlgee in each part of the test Is shown in Tahle-I 
below : 
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TABLE- I. 


Niunber of Questions Testing Diffarent 
Objectives in Part -I and 
Part II of the 
Open-Book 
Test. 


Part 
of the 
Test. 

Objective 
if’orm : 
of • 

Ques • 

tions. ... 

Knowledge 

Under- Appll- 

standing. cation. 

Total 

I 

Multiple 

9 

11 9 

29 


Choice 




II 

Short 

6 

6 7 

19 


Answer 





The time allowed for Part-I was 46 minutes and 
there were four choices in every multiple choice of question 
out of which only one was correct. The time allowed for 
Part-II of the test was one hour and twenty minutes. 

The questions were set from the syllabus of 
Geometry prescribed for class IX for the session 1966-67j 
out of which that portion was deleted which could not be 
taught in ninth class in one or more classes of the said 
three schools. The syllabus is given in the second halF of 
the Appendix-C. 

The objectives tested by these questions were 
judged by seven Judges - 2 experts from the Department of 




■12 


Currlouluin sind. Jivalu&'tioii and. 5 SQcondary school taachsrs 
of Mathematics, 

3, Directions given to the Subjects: 

For administering the Open-Book Test, the 
subjects were given two types of instructions at two 
different times, namely, 

(a) Instructions to the subjects given one 
weak before the administration of the 
test.(For details see Appendix-C) 

(b) Instructions to the subjects at the 
time of the adminstratlon of the test 
(For details see Appendix-D)• 

4, Administration of the Test : 

For Part-I of the test a separate answer-sheet 
(specimen given in Appendlx-E) was given which was collected 
after 45 minutes since the beginning of the test, and for 
Part-II blank answer-sheets were supplied on which they wrote 
their answers. In this way the open-book test was adminis¬ 
tered in three schools on the dates fixed by the respective 
principals of the schools. The question paper was also taken 
alongwith the scripts. The test was administered only in 
one school at a time. 

In both the parts of the test there was no case 
of 'Not Reached*. To some of the examinees some extra time 
was also allowed, but there were very few such cases. 




5 a Some OlDservatlons: 


(a) STUDSNTS» iiEACTIONSj 

Students displayed keen Interest towards this type 
of test. Each of them brought a lot of books and note books 
with them. On the conclusion of the test soma of the pupils 
expressed strong favour for such examination. 

(b) Teachers* Reactions s 

Teachers of these schools on the whole evinced great 
interest In this type of examination. Some of them, however, 
raised doubts regarding the feasibility of such examinations 
in practice, others thought that all students shall be 
scoring 100 per cent marks on this type of test, yet some 
others desired to know whether open-book tests could be 
held in other subjects also. 

In short the interest displayed by both - pupils 
and teachers - was very encouraging. 

6. Scoring of Scripts s 

For the scoring of scripts of Part-rl of the test, 
three Scoring keys were prepared, one for the questions 
based on the objective ®f Knowledge, the second for the 
questions based on the objective of Understanding, and the 
third for the questions based on the objective of Applica¬ 
tion. This ensured correctness of scoring though it took 
a little more time. In each round the scripts were assessed 
in a different ink and this facilitated for counting of 
scores obtained by students on different objectives. 




Every correct answer was scored one mark and 
every wrong answer was scored as zero* 

Part-II of the test consisted of the anestions 
of short-answer type. It was assessed with the help of 
a marking scheme. It was also examined ob 3 ectlve-wlse 
In three rounds using different colours of inks for differ¬ 
ent objectives as in the case of Part-I of the test. For 
each of the questions of short-answer type there were two 
marks, so values for different points in terms of marks 
were allotted. So these answers were scored either 
zero or 1/2 or 1 or or 2. In case the total of scores 
on the questions based on any objective was in fractions, 
it was changed to next higher integer. 






CHAPTBR-lII, 


TABULA‘II0N of _D_A_I_A_. 


/-/aVIWG compiled the scores of three school tests 
of all the students of these three schools, and the scores 
of these pupils on the open-book examination Part-I and 
Part-II, the tabulation and analysis of these data is 
done in the following steps: 


A. 


CONVERSION OF RAW SCORES OF SCHOOL ACHIEVEMENT 
INTO THE standard SCORES AND THUS TO COMPOSITE 
standard SCORES; 


As the pupils for the 'H* and the 'L' groups were 
to be selected, their raw scores of school tests were, 
therefore, converted into the standard scores (z-scores). 
For this purpose, first of all the means and the standard 
deviations of the scores of pupils on three tests of 
these three schools were calculated separately which are 

shown in TABLE-II* 

On the basis of these data the standard scores of 
these pupils on different tests were calculated with the 
help of the following formula: 

1-Guilford, J 4 P 4 J Fundamental Statistics in psychology 
and Education, New York: Me Graw-Hill Book Company, 

fourth edition, 1966, pt 128. 




o o 


TABLE - II* 


Maximum marks, Means and Standard Deviations of 
the Raw Scores of the Pupils of the 
Three Schools on Three Respective School Tests. 


Schoo1 

No, 

Test 1 

Test 2 

Test 3 

1. m-m! 

50 

60 

15 

M* 

25.08 

32.42 

6.43 

S.D, 

11.16 

11.90 

2.84 

N- 

98 

98 

98 

2. M*M. 

30 

60 

50 

M* 

12.16 

39.37 

24.91 

S.D* 

5.12 

13.33 

11.04 

N* 

44 

44 

44 

3. M*M. 

76 

60 

50 

M- 

40.90 

28.82 

21.84 

S-D, 

20.00 

10.75 

7.37 

N. 

38 

38 

38 


♦ For the key to abbreviations see Appendix-A. 
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X 

where z stands for the standard score, 

X ,, ,, raw score 

M .. .. the mean of raw scores,and 

X ,, >y the standard deviation of 

raw scores* 

In this way the raw scores of all the pupils 
of these schools on the three school tests were converted 
into standard scores. The standard scores thus obtained 
were added together for each pupil to obtain their 
respective composite scores. 

B. SElilCTION OF THS BRIGHT AND THB WBAJC PUPILS 
FOR THS ‘H* AMD THB ’L* GROUPS: 

The composite scores thus obtained gave the 
relative standing of pupils on the basis of school tests 
in Geometry. They were then arranged in descending order 
that is, the pupil with highest composite score was 
placed at the topi the pupil who scored the lowest compo- 
-site was placed at the bottom. 

After arranging the scores of 180 students in 
this order the top fifty pupils were selected for the 
upper group or ‘H* group and the bottom fifty pupils were 
selected for the lower group or 'L' group. 

C tabulation op scores of THB PUPILS OBTAINED 
ON THE OPEN BOOK TEST- 


The scores of the pupils obtained on the questions 
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based on the objectives of Knowledge, Understanding and 
Application on the open-book test were tabulated for Part-I 
and Part-II separately. Their respective means, standard 
deviations and variances were also calculated which are 
shov/n in the Table-Ill, 

To facilitate comperlson these marks were, then, 
converted to the same maximum marks for each set of 
questions based on the same objectIvej that is, to 9 in 
the case of Part-I and 12 in the case of Part-II# These 
marks are shown in Table-IV# 

D, tabulation of scores of THE PUPILS OF THE 
UPPER AND THE LOWER GROUPS OBTAINED ON THE 
OPEN-BOOK TEST, 

Now the scores of the pupils of the upper and 
the lower groups obtained on the questions based on the 
objectives of Knowledge, Understanding and Application on 
the open-book test were tabulated separately for the two 
parts of the test. Their means, standard deviations and 
variances were also calculated which are shown in the 
Table-Y. 


As the marks for different sets of questions of 
each part based on different objectives were different, 
bhey were converted to the same maximum marks. The 
corresponding means, standard deviations, and variances 
were also then worked out. These are shovm in Table-VI. 




MLE-III, 


Means scoresj Standard Deviations and Variances 
of 180 pupils on Questions Testing 
Different Objectives on the 
Open-Book Test in Geometry* 


Part of Objective. 

--»- 

M.M, M, 

3-D- 

V- 

the Test. 





I 


(Multi- 

Kn 

9 

5.66 

1.414 

2.00 

choice) 

Un 

11 

6.93 

2.29 

5.24 


App 

9 

3.12 

1.57 

2.46 


11 

(Short 

Kn 

12 

5.53 

4.01 

16.08 

Answer) 


Un 

12 

4.07 

3,41 

11*61 


App. 

14 

2.56 

2.28 

5.20 


♦ For key to abbreviations see Appendix-B. 





Mean Scores, Standard Deviations and Variances 
of 180 pupiL" on Questions Testing Different 
Objectives on the Open-Book Test in Geoms 
-tory converted to same maxitnnm msrkSi 


Part of 

Objective. 

M.M. 

M. 

S.D. 


the Test. 


r 




I 

Kn. 

9 

5.66 

1.414 

2.00 

(Multi- 

choice) 

Un. 

9 

5.67 

1.87 

3.51 


App. 

9 

3.12 

1.57 

2.46 

II. 

Kn. 

12 

5.53 

4.01 

16.08 

(Short 

Un, 

12 

4.07 

3.41 

11.61 

Answer) 

^P* 

12 

2.19 

1,95 

3.82 


?or key to abbreviations see Appendix "A 



■21 


TABLE - V, 


Maximum Marks, Means, Standard Deviations and 
Variances of the Scores on the Questions testing 
Knowledge, Understanding and Application of the 
Pupils of Upper and the Lower Groups obtained 
in the Open-Book Test ( N = 50 ) 


Tvne of■. 

Acquisition 
of Knowledge 

Development 
of Under- 

Application 

Of know- 

Questions 

Group.: 


standing. 

ledge. 







Multi- 

H 

M.M. 

9 

11 

9 

choice 


M. 

6.14 

7.56 

3.72 




1.67 

2.49 

1.40 



V. 

2.80 

6,20 

3.40 


L 

M-M. 

9 

11 

9 



M- 

5.44 

6.80 

2.68 



S.D. 

1.53 

2.15 

1.33 



V,. 

2.33 

4.64 

1.78 



H-M- 

12 

12 

12 



M- 

7.94 

6.84 

4.56 

Short 


S.D, 

2.33 

3.35 

2.56 

Answer 


V. 

5.42 

11.21 

6.56 


L 


12 

12 

14 



M, 

4.24 

6.84 

1.04 




3.14 

2.35 

1.02 



V. 

9.84 

5.54 

1.04 


* For key to abbreviations, see Appendix-A 
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TABLE - VI, 

Maximuni Marks, Means, Standard Deviations 
and Variances of tlie Scores on the Questions 
Testing the objectives of Knowledge, Under¬ 
standing and Application of the Upper and 
the Lower Groups obtained on the open-book 
test with changed maximum marks (N=50) 

Type of 
qua st ions. 

Group. Acquisition 

of Knowledge 

Develop- Application 

ment of of Knowledge 

Under- 
st anding. 


m " ' 

M.M, 9 

9 

9 



M. &*14 

6 .19 

3.72 


H, 

S-D- 1-S7 

2.04 

1.84 

Multl- 


V- 2.80 

4.16 

3.40 

Choice 







M-M. - 9 

9 

9 



M, 5.44 

5 a 56 

2.68 


L« 

B.D. 1.525 

1.76 

1.33 



V. 2.326 

3.09 

1.78 



M-M- 12 

12 

12 



M. 7.94 

6 .84 

2.68 


H. 

S.D. 2.33 

3.25 

2.35 

Short - 


V. 5.42 

11.21 

5.54 

Answer. 







M,M. 12 

12 

12 



M. 4.24 

3.91 

0.89 



S,D. 3.14 

2.19 

0.874 



V, 9.86 

4^81 

0.76 

* For Key to 

abbreviations see 

appendix - A. 
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The above conversions vrere done v/ith the help of 
statistical formulae. To convert the mean and the S.D. 
the following two principles were kept in mind. The 
first is : 

" Let each of W scores be multiplied by a constant 
amount C. Then the mean of the new set of scores 
thus fomed is equal to the mean of the original 
set multiplied by this constant amount, 

or symbolically, 

- 2 

Mcx = CX 
and the second is: 

'• Let each of N Scores be multiplied by a 
constant amount C. Then the variance of the 
new set of scores thus formed is equal to the 
variance of the original set multiplied by the 
square of this amount. 

Or symbolically, 

^cx = 

ticx - Csx 




*2. Blommers, Paul and Lindquist E,P., Elem ent 

Statistical Methods, Boston; Houghton Mifflin Company 
1960, p. 113. 

3. Ibid, Pp. 149-9. 



CHAPTER - IV. 


/Analysis /^nd T^terpretation 

ZTf 


A- ANALYSIS OF DATA FOR THE FIRST HYPOTHESIS: 

The data shown In Table-IV will be analysed 
as shown in Table-VII and Table TUI to see whether 
the mean scores of sets of questions testing different 
objectives are the same except for chance errors. 
Table-VII shows the statistical analysis for Part I of 
the open-book test, whereas Table VIII shows the same 
for Part-II of the test. 

B. RESULTS OF TABLES VII AND VIII: 

1. In Table-VII, it may be seen tliat in the 
case of multiple-choice type of questions, the mean 
Score of pupils on the questions testing Knowledge 
or Understanding Is 5.66/9 or about 63 whereas on 
the questions testing Application is only 3.12/9 or 
hardly 35S^. 




TABLE - VIL 


Significance of Difference Between Mean Scores of 
180 pupils on Three Dlfferentse sets of Multiple-Choice 
Type of Questions, Each set Testing Different Objective 
in the Open-Book '^’est. 


“k 


«a 

p 

D 


t 


(V) 

iv) 

(V) 






5.66 

5.67 


• 552 

-0.01 

.120 

-0.083 

* 

NS 

(2) 

(3.51) 







5i66 


3.12 

.469 

2.54 

.116 

21.2 

** 

HS 

12) 


(2.46) 







5.67 

3.12 

■444 

2.55 

.137 

18.61 

** 

HS 


(3.51) 

(2.46) 







* Not Significanti 

** Highly significant, much beyond tOl level. 





TABLE VIII 


Significance of Difference Between Mean Scores 
of 180 Pupils on Three Different Sets of Short 
Answer Type of Questions, Each Set Testing 

DiIpEMT objective in tie open book TEST- 


(V) 

M 

u 

^V) 

M 

a 

Cv) 

r 


3.E- 

t 


S.53 

4.07 


.620 

1.46 

.245 

5.93 

HS* 

(16.08) 

(11.61) 







5.53 


2.19 

.572 

3.34 

.246 

13.58 

HS 

(16.08} 


3.82) 







4.07 

2.19 

.572 

1.88 

.208 

9.04 

BS 


(11.61) 

(3.82) 







* Highly significant, much beyond #01 level• 




-27- 


2. The data reveals that in an open-book exami¬ 
nation, in the case of multiple-choice type of questions, 
differance between the mean scores on the objectives of 

a. Knowledge and Understanding is not slgnifl- 
-cant, 

b. Knowledge and Application is highly signi- 
-fleant, l*e* much beyond the level .01 j 

c* Understanding and Application is again highly 
significant, 

d. Knowledge and Application is more significant 
than any of the other pairs of objectives. 

3. In table VIII, it may very well be noted that 
in an open-book examination, in the case of short-answer 
type questions, the mean score of pupils on the questions 

testing 

a. Knowledge is 5.53/12 or about 46 percent, 

b. Understanding is 4.07/12 or about 34 per cent, 

c. Application is 2.19/12 or about 18 per cent, 

4. It may also be noted that in an openuabook 
examination, in the case of short-answer type questions, 
the difference between the mean scores on the objectives 

of 

a. Knowledge and Understanding, 

b. Knowledge and Application, and 
e. Understanding and Application, 




iB highly significant, l.e., much beyond the 
•01 level, 

d. Knowledge and Application is more significant 
than any of other pairs of objectives* 

C* liWRPRBTATION OF RESULTS OF TABLES VII AND 
VIII: 

la In the case of multiple-choice type of 
questions, it may therefore be said that in open-book 
examinations pupils are very likely to score high 
percentage of oiarks (Mean about 631^) on questions testing 
Knowledge or Understanding, but In the case of questions 
testing Application the likelihood Is that pupils would 
not score high percentage of marks (mean about 35^). 

i 

2a In the case of short-answer type of questions, 
the likelihood is that In open-book examinations pupils 
will score high but not very high marks (Mean about 46 s£) 
on the questions testing Knowledge, and that the 
percentage of scores on questions testing Knowledge will be 
much higher than that on questions testing Understanding 
or Application, whereas in the case of questions testing 
Understanding, the mean score cannot be said to be even 
high (Mean about 34^), but in the case of questions 
testing Application pupils are very likely to score low 
marks (mean about IS^) . 


It will further be noted that in the open-book 
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examination the mean scores of pupils on different 
objectives differs significantly from each other in the 
case of short-answer bype of questions, whereas in the 
case of multiple-choice type of questions, the questions 
testing Application only differ significantly from 
questions testing either Knowledge or Understanding, but 
there is no difference between mean scores of pupils on 
multiple choice type questions testing Knowledge or 
Understanding. 

D. CONCLUSION FOR THB FIRST HYPOTHESES 

Thus it can be said that 

1. In an open-book examination, in the case of 
mul b iple-choice type questions, pupils' performance does 
not differ on questions testing, Knowledge or Understanding, 
and they score very high marks on these objectives but 
their performance on questions testing Application is 
significantly different from that on questions tasting 
either Knowledge or Understanding; 

2. In an open-book examination, in the case of 
shor t -answ er type questions, pupils' performance on 

- different objectives is significantly different 
from each other, scoring highest marks on questions testing 
Knowledge and lowest marks on questions testing Application, 
thus confirming the hierarchy of Objectives of Knowledge, 




Understanding and Application, 


E* ANALYSIS OF DATA FOR THE SECOND HYPOTHESIS; 

Mean scores of High, Middle and Low groups on 
different objectives in Part-I and Part-II of the open- 
book test are shown in Table-ix. To find whether the 
mean scores of High, Middle and Low groups differ signi¬ 
ficantly from each otheranalyeis of variance was done for 
each of the tables x to XV in which all were found signi¬ 
ficantly at least at ,05 level so Student^s *t* test was 
applied for each pair of High, Middle and Low group mean 
scores in each objective for both the parts of the test. 
These are shown from Table X to Table XV. 

P. RESULTS OP TABLES X TO XV: 

Prom Tables x to XV, it is evident that in an 
open-book examination ; 

1, In the case of multiple-oholee type questions 
testing Knowledge, the difference between mean 
Scores of 

a. High and Middle groups is significant at 
•05 level; 

b. High and Low groups is significant at 
•06 level, 

c. Middle and Low groups is not significant. 
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TABLE - IX 


Mean Scores and Variances of High, Middle 
and Low Groups on Different objectives on 
questions in Part-I and Part II of the 
Open-Book Test, 


Part of 
the Test. 

Objec¬ 

tive, 

“h 

1 

' 

1 

«e 

(V) 


Kn 

6,14 

CS.80) 

5.49 

(1.114) 

5.44 

(2.326) 

I 

Un 

6,19 

5.43 

5.56 

Multi- 

Choice. 


C4.16) 

(2,79) 

(3.09) 


App 

3.72 

{3 

3.013 

(2.011) 

2.68 

(1.78) 



Kn 

7.94 

(6.42) 

4.84 

(21.68) 

4.24 

(9.86) 


Un 

6.34 

3.46 

2.68 

II 

Short - 


(11.21) 

(7.30) 

(5.24) 

Answer, 


App. 

3.91 

(4.31) 

1.94 

(1,95) 

0.89 

(0.76) 


Por the key to sOabreviations, see Appendix-A, 
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TABLE - X- 


Signiflcance of Difference Between Mean Scores 
of Upper, Middle and Lower Groups In Multlple- 
cholce type Questions testing Knowledge ***" 


(V) 

M 

in 

£V) 

(V) 

D 

i 

! 

1 

t 

Significant 
at the leve 
of 

6.14 

(2.30) 

5.49 

(1.114) 


0.65 

.267 

2.43 

.05 

6.14 

{2.80) 


5.44 

(2.326) 

0.70 

.3234 

2.16 

.05 


5.49 

(1.114) 

6.44 

(2.326) 

0.05 

.119 

0.42 

NS 


For key to ablffrevlatlons, see Appendlx-A« 
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table - XI 


Significance of Difference between Mean Scores of 
Upper, Middle and Lower Groups in Multiple-Choice 
type Questions testing Understanding. 


(V) (V) 

(V) 

0 

s.s. 

t Significant 
at the level 
of 

6.19 5.43 


0.76 

.347 

2.19 

.05 

(4.16) (2.79) 






6.19 

5.56 

0t33 

.385 

1.64 

ns 

(4.16) 

(3.09) 





5,43 

5,56 

-0.13 

.314 

1—1 

• 

O 

1 

NS 

(2.79) 

(3,09) 






For key to abbreviations, see Appendix-A. 




TABLB-XIL 


Significance of Difference between Mean Scores of 
Upper, Middle and Lower Groups in Multiple-Choice type 
Questions testing Application, 


R M 

h m 

(V) (V) 

«1 

(V) 

D 


t 

Significant 
at the level 
of 

3«72 3«013 


0.707 

0.308 

2.30 

.05 

(3.40) (2.011) 






3.72 

2.68- 

1.04 

0.325 

3.20 

.01 

(3,40) 

(1.78) 





3.013 

2.S8 

0.333 

0.249 

1.34 

NS 

(2.011) 

(1.78) 






For Key to abbreviations, see Appendlx-A. 
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TABLK - XIII 


Significance of Difference between Mean Scores 
of Upper, Middle and Lower Groups in Short-Answer 
type Questions testing Knowledge, 


Mv M 

(V) (V) 

Ml 

(V) 

D 


t 

Significant 
on the level 
of 

7.94 4.34 

(5.42) (21.68) 


3.10 

.621 

4.99 

beyond 

.01 

7.94 

(5.42) 

4.24 

(9.86) 

3.70 

.553 

6,63 

beyond 

.01 

4.84 

4124 

0.60 

.690 

0.87 

NS 

(21.68) (9.86) 






For key to abbreviations, see Appendlx-A. 
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TABLE- XIV- 


Significance of Difference between Mean Scores of 
Upper, Middle and Lower groups in Short Answer type 
Questions testing Understanding. 


n n 

(V) (V) 

“l 

(V) 

’1) 

S.E. 

t ' 

Significant 
at the level 
of 

6,84 3.46 

£11.21)(7.296) 


3.38 

0.567 

5.96 

Beyond 

.01 

6.84 

(11.21) 

2.68 

(5.24) 

4.16 

0.579 

7.18 

Beyond 

.01 

3.46 

2.68 

0.78 

0.446 

1.75 

NS 

(7.296) 

(5.24) 






For key to abbreviations, see Appendlx-A- 



TABLS - XV. 


Significance of Difference between Mean Scores 
of Upper, Middle and Lower groups in Short-Answer 
type Questions testing Application. 


\ \ \ D S.B. t Significant 

(V) (V) (V) at the level 


3.91 1,94 


1.97 

(4.31) (1.95) 



3.91 

0.S9 

3.02 

(4,81) 

(0.764) 


1.94 

0.89 

1.05 

(1.95) 

(0.764) 



0.350 5.63 HS 

Beyond .01 


0.337 8.96 HS 

Beyond .01 


0*201 

5,22 HS 
Beyond .01 


For key to abbreviations, See Appendlx-A. 
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2* in the case of amltIple-choIce type of questions 
testing UnderstandIng , the difference between 
mean scores of 

a* High and Middle groups is significant at 
•05 level, 

b. High lb Low groups Is not significant, 

c. Middle and Low groups is also not significant. 

3. in the case of multiple-choice type of questions 
testing Application, the difference between mean 
scores of 

a« High and Middle groups is significant at 
•05 level, 

b. High and Low groups is significant at .01 
level} 

c. Middle and Low groups is not significant. 

4. in the case of short-answer type of questions 
testing Knowledge, the i difference between 
mean scores of 

a. High and Middle groups is highly significant 
Ci.e. much beyond .01 level)} 

b. High and Low groups is highly significant} 

c. Middle and Low groups is not significant. 

5. in the case of short-answer type of questions 
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testlng Understanding, the difference between 
mean scores of 

a* High and Middle groups Is highly significant; 
b. High and Low groups is also highly significant; 
a. Middle and Low groups is not significant. 

6, In the case of short-answer type of questions 
testing Application, the difference between mean 
scores of 

a. High and Middle groups Is highly significant; 

b. High and Low groups Is highly significant; 

e. Middle and Low groups Is also highly significant; 

G, intebphetation of results of tables X to XVi 

(1) In the case of multiple-choice type of questions 

in an open-book examinations testing 

(a) Knowledge . it may be said that the probability Is 
more than .95 that pupils of High group will score more than 
the pupils of Middle group. The same is the case for the 
pupils of High group in comparison to the pupils of Low 
group, but the questions testing Knowledge do not differen¬ 
tiate or discriminate between the pupils of Middle and Low 
groups; 

(b) Understanding . The chances are 95 out of 100 
that the pupils of High group will score higher than the 
pupils of Middle group, but the questions testing Understanding 




do not differentiate the pupils of Low groups from either 
Middle group or High group significantly. 

(c) Application , the probability is .95 that the 
pupils of High group will score higher marks than the 
pupils of Middle group, and it can be said that the 
probability is more than .99 that the pupils of High 
group will score higher marks than those of Lower group, 
but these questions do not differentiate or discriminate 
significantly between the pupils of Middle and Low 
groups, 

(2) In the ease of Short-answer type of questions in 
open-book examinations testing 

Knowledge, the chances are much more than 99 per 
cent that the pupils of High group will score higher marks 
than tlie pupils of the Middle or Lower group, but pupils 
of Middle and Lower groups will not be discriminated 
significantly fium each other; 

Cb) Understanding, the probability is much more than 
.99, that the pupils of High group will score higher marks 
than the pupils of the Middle or Lower group, but it is 
very likely that it will not discriminate significantly 
between the pupils of Middle and Lower groups; 

Cc) Application , the probability is more than .99, 
that the pupils of High group will score significantly 
higher marks than those of Middle or Lower groups, and 
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puplls of Middle group will also be significantly discrimi¬ 
nated from those of low group. In other words it can be 
Said that the chances are much more than 99 out of 100 that 
such type of questions are most discriminative. 


H. CONCLUSION FOR THE SECOND HYPOTHESIS* 

In sliort it can be Said that in an open-book 
examination 

I. in the case of multiple-choice type of questions 
the chances are greatest in the case of questions testing 
Understanding that pupils with varying levels of ability 
will not differ significantly from each other, whereas 

the probability is less than .05 in the case of questions 
testing Application that pupils with varying levels of 
ability will not differ significantly (except in the 
case of pupils of Middle from Low group) from each 
other; 


2. in the case of short-answer type of questions, 
it Is very likely that the pupils of Middle and Lower 
groups will not differ significantly from each other on 
the questions testing Knowledge or Understanding, but 
the pupils of High group will score significantly higher 
marks than those of Middle and Lower groups on these 
objectives, whereas the probability is much less than 
.01 in the case of questions testing Application that 
pupils with varying levels of ability will not differ 
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slgnlfleantly from each other. 

In. other wordsj 

“ Bhort-answer type of questions testing 
Application ai'e most discriminative of all the objectives" . 

I. ANAiYSIB OP DATA FOR THE THIRD HXPOTHSSiSt 

The simplest index for discrimination is tiie 

difference where p.^ and p-j^ are marks obtained 

divided by maximum marks for the upper and the lower 

groups respectively, Lawshe^ has given a better index 

zu-zl (also called D)» where au and al are the normal - 

curve deviates corresponding to p and p., • 

u 1 

The proportions and standard deviations of 
Upper and Lower groups are shown in Table-XVI and Lawshe's 
Ds are shown in Table-XVII. 

J. RESULTS OP TABLS-XVII* 

From Table-XVII it is evident that in open-book 
examinations Lawshe^s discrimination index 

1. in the case of multiple-choice type of questions 
testing 

a. Knowledgej is .377 

b. Understanding , is ,223 

c. Appllcatlon j is .9395 and 

1. LaWBh 0 ,C.H.Jr. as quoted in Guilford,J.P. Psychometric 
Methods . Tokyo; Kogakusha Company,Ltd.International 
Student Edition,Second Edition,1964, Pp*426. 
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TABLE - XVI. 


Proportions of inarlts and Standard Deviations of 
Scores of Pupils of the High and the Low Groups 
on Questions Testing Different Objectives in 
Multiple-choice and Short Answer type of ques¬ 
tions in the Open-Book Test, 


Type of 
Qns • 

G' Objective 
r'» 

0 • 
u ' 

P ' 

r 

Kn, 

Un. 

ApPi 


H 

P. 

•682 

.688 

.413 

Multi- 


S.D, 

.186 

.228 

•204 

Choice, 







L 

P. 

.605 

.618 

•298 



S.D. 

.170 

.196 

.148 


H 

P. 

•662 

.570 

.326 



S.D.7 

,194 

.271 

.183 

Short- 






AnSi 

L, 

P. 

.353 

.223 

.074 



S.D. 

.262 

,196 

.073 


For Key to abbreviations, see Appendix-A, 
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lABIS . XVIL 


Discrimination (Lawshe<s D) of Questions based on 
Different Objectives of Multiple-choice and short- 
answer type of Questions in Open-Book Test. 


Type of 

Objec- 

K- 

Pu 

Pj_ zu zl 

D or zu- 

■ Remarks. 

Qns. 

tlve, 


» - zl 

Multl- 

cholce. 

Kn, 

.682 

.605 0.995 0.618 

.377 



Un. 

.638 

.618 0.325 0.602 

.223 

Least Dlscrl 
mlnatlve. 


App. 

.413 

.298 -0.426-1.365 

.939 

Most Discri¬ 
minative, 

Short 

Kn 

.662 

.353 0.835 -0.561 

1.396 

Least Dlscrl 

Answer. 

Un. 

.570 

.223 0.258 -1.413 

1.671 

minative. 


App. 

.326 

.074 -0.951 -5.836 

4.885 

Most Discri¬ 
minative , 


For key to abbreviations, see Appendlx-A. 

a 
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2. In the case of short-answer questions testing 

a. Knowledge, is 1.396 

b. Understanding, is 1.671 

c. Application, is 4.885 

K- interpretation of results of T/iBLS-XVII. 

From Table-XVII it is evident that in an 
open-book examination 

1. the multiple-choice type of questions 

testing 

a. Understanding are least discriminative 

b. Appllcptlon are most dlscrliiilnative, 

2. the short-answer type of questions testing 

a. Knowledge are least discriminative, 

b. Application are most discriminative, 

in comparison to other objectives. 

L. STATISTICAL ANALYSIS FOR THE THIRD 

HYPOTHESIS WITH THE HELP OF 't» TEST, 

Normally, the difference between the mean 
scores of the Upper and the Lower group are taken as the 
rough measure of discrimination. But in such cases the 
variability of scores Is not given any lo^jortance, In 
fact the variability also plays a significant role. 

Hence to find low distant the mean scores of the upper 
and the lower group from each other are, we shall measure 
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this distance in terms of the units of the normal-deviate. 
The greater this difference is, the more discriminative 
the question or set of questions will be. 

These distances bet'veen the mean scores of the 
upper and the lower group in terms of the units of normal 
deviate are shown in Table-XVIII. 

The standard error of the difference between 

mean scores of the H group and the L group is calculated 

2 

with the help of the following formula: 

= fL + J 

»1 Ng 

where s N 2 ; N 

S.S. or 

W 

M. RESULTS OP TABLB-XVIII: 

Prom Table-XVIII it is evident that in an 
open-book examination the distance Cin terms of units 
of the normal-devlate) between the mean scores of 
pupils of the High and the Low groups 

2- Walker, Helen M., and Lev Joseph, Statistical 

Inference , Calcutta: Oxford and IBH Publishing Co., 
First Indian Edition, 1965, p. 157 
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TABLE - XVIII 


CalGulation of the Distance betuveen the Mean Scores of 
the Upper and the Lower groups in units of the normal- 
ddvlate for each set of questions based on separate 
objectives for both the type of questions- Multiple 
choice and Short-Answer. 


Ob jectlve 


r 

0 

u 

p 


H 


M 

CV) 

M 

CV) 


S»E. 

't' 

£D/SE. 


Un 


App 


Multiple-Choice Question . I Shor t-Answer Questions 
Kn. Un App j| Kn 

I 
J 
i 


6.14 


0.70 


6.19 


3.72 


I 


7.94 


6.84 3.91 


(2.80) (4.16) (3.40) { (5.42) £11.21) (4.81) 


5.44 5.56 2.68 j 4.24 2.68 0.89 

(2.326) (3.09) (1.78) } (9.86) (5.54) (0.764) 


0.63 


1.04 I 3*70 4.16 3.02 

]i 

J 

0.3234 0.3847 0.3250 { 0i5584 0.5847 0.3370 

} 

J 

2.16 1.64 3.20 } 6.63 7.11 3.96 


Remarks, 


Least Most Least Most 

Discrl- Dlscrl- Dlscrl- Dlscrl- 

minatIve.mlnatIve.mlnative. minatIve. 


For key to abbreviations, see Appendlx-A. 
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!• In case of multiple-clioice type of questions 

a. Knowled ge Is 2.16 

b. Understanding is 1.64 

I— r il* 

c. Application Is 3.20 
and 

2. in case of short-answer type of questions 

a. Knowledge is 6.63 

b. UnderstandIng is 7.11 

c. Application Is 3.96 

N. INTERPiiBTATIOW OF RESULTS OF TABLE XVIII; 

From Table XVIII it is evident that in an open- 
book examination 

1, the multiDle-choice type of questions testing 

a. Understanding are least discriminative, 

b. Application are most discriminative, 

2. the short-answer type of qnestions testing 

a. Knowledge are least discriminative, 

b. Application are inost discriminative in 
comparison to other objectives. 

It can also be inferred that In an open-book 


testing 


testing 


examination short-answer type of questions are more 




discriminative than, multiple-choice type of Questions 


0. discrimination with thb help op comparing 

MEAN SCORES OF PUPILS V/ITH VARYING LEVEL 
OF ABILITY: 

For comparing the mean scores of pupils of 
High, Middle and Low groups, the results of Tables 
X to XV are shown in Table-XIX• 

P- INTERPRETATION OF TABLE-XlX* 

We know that greater the difference between mean 
scores of pupils with varying level of abilities on any 
test, the more discriminative that test v/111 be. 

Prom Table XIX, it is obvious that In an open- 
book exaralnatlon 

!• the multiple-choice type of questions testing 

a« Understanding are least discriminative, 

b. Application are most discriminative, 

2m the short-answer type of questions testing 

a, Knov/ledge are least discriminative, 

b. Application are most discriminative In 
comparison to other objectives. 




TABLE - XIX 


Discrimination by sets of questions testing separate 
objectives in two types of questions with the help of 
't* test on difference between mean scores of different 

groups. 


Type of 
ques¬ 
tions. 

Objec¬ 

tive. 

Mh ' 

Mm 

Ml 

tet— 

■> JW !■! Ijll^ ■ 

Level 
of si¬ 
gnifi¬ 
cance 

Remarks 



6.14 

5.49 


2.43 

.05 

One NS 

Multi- 

TT— 







Choice. 

Kn 

6.14 


5.44 

2,16 

.05 

and no .01 




5.49 

5.44 

0.42 

NS 



6.19 

5.43 


2.19 .05 

Two NS,hence 
least discri¬ 

Un 6.19 


5.56 

1.64 NS 

minative. 

£s.4S 

&.S6 





5.43 

5.56 

-0.414 NS 




3.72 

3.013 

2.30 

.05 

One NS,and 
one .01,hence 

App. 

3.72 

2.68 

3.20 

.01 

most discrimi¬ 


3.013 2.68 

1.34 

NS 

native. 



Short- 


■ 7.94 

4.34 


4.99 

.01 

One NS,with least 

Answer. 

Kn 

7.94 


4.24 

6.63 

.01 

t*s, hence least 
discriminative. 




4.84 

4.24 

0.87 

NS 




6.84 

3.46 

2.68 

5.96 

7.18 

.01 

.01 

One NS, but its 
»t' values are 


Un 

6.34 

3.46 

greater than 
that of Knowledge 

2.68 

1.75 

NS 


Contd 


51) 
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3.91 1.94 

App 3.91 0.89 

1.94 0.89 


5.63 

.01 

All significant 



at .01 level, 

8.96 

.01 

hence most 



discriminative. 

5.S3 

.01 



For Abbreviations, see Append,Ix-l.A. 


^i(Bdonal iDstitu’e of EducaU^^. 

LICM^V gg 

Acc. 'No.\-V" Q /w 

.-in-- 
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Q. discrimination with the help of coefficient 

OF CORRELATION: 

The discrimination of different levels of achievers 
by cjuestlons testing, different objectives can be compared 
by their respective coefficients of correlation with the 
criterion scores (composite scores on the basis of three 
School tests). The higher the coefficient of correlation 
of a test with the criterion, the greater the discrimina¬ 
tion of the test or test item is; for higher coefficient 
of correlation of a test or test Item (than any other 
test) with the criterion means that the relative standing 
of pupils on that test (than the other test) bears 
greater similarity to that on the criterion test. 

Again, 

“ The validity of an item is essentially the 
discriminating power of the right answer,.,, 
the resulting coefficient dan be regarded 
as Indicating the discriminating power or 
validity of the particular answer that Is 

keyed as correct.Thus the correlation 

coefficient of each alternative whether right 

Q 

or wrong, with the criterion may be obtained," 

3, Wood, Dorothy Adkins, Test Construction - Development 
and Interpretation of Achievement Tests , Columbus,Ohio: 
Charles S,Merrill Books, Inc, 1961, p,87. 
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The significance of is difference betvveen these 

ooefflGients of correlation is also calculated and is 

shown in Tahle-xxi. Here the 't' test was applied. The 
« , 4 

formula used for it was ; 


t = CV -V ) /~~ Clfrxy) 

xz yz^ / —--- 

R. RESULTS OF TABLES XX ATID XXI 

It is evident from Table XX that all the coefficients 
of correlation are significant at .01 level. The significance 
of difference between these coefficients of correlation is 
also given in Table XXI. 

From Table XXI, it is evident that 

1. in the case of multiple-choice type of questions 
in open-book examinationj the coefficients of correlation of 
criterion with questions testing Knowledge as well as Under¬ 
standing are not significantly different from each other; 
in other words it is very likely that the observed difference 
between these two coefficients of correlation may be due to 
chance, whereas the probability of this is much more than 
.99 that r^a is higher than either or r^uj and 


4* Walker, Helen M., and Lev Joseph, Op . Clt . p,257 
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WIS, - XXI 


Significance of Difference between Coefficients 
of Correlation of Criterion Scores (X) with scores 
on Different Open-Book Sets of Questions Each 
Testing Separate Objective, 


Ijpe 1 
of ' 

Ques- • 
tion • 


r 

XU 

r 

*xa 

t 

Level of 

slgniflca- 

-nce. 


.39 

.38 


1.38 

NS 

Multlple- 

Choice. 

.29 

■ 

.70 

7.43 

.01 


■ 

.38 

.70 

5.68 

.01 


.41 

.54 


2.37 

.05 

Short- 

.41 


.68 

5.30 

.01 

Answer, 


.54 

.68 

2.84 

.01 


For key to ^breviatlons see AppendIx-A , 
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2* In the case of short-answer type of questions 
In open-book examination the coefficients of correlation 
between Knowledge and Understanding with the criterion is 
significant at .05j whereas the probability is more than 
.99 that r^a higher than either r^^j^ or r^^^. 

S. INTERPRETATION OF TABLtii XX . 

Table XX shows that all the coefficients of 
correlation of these tests testing separate objectives 
with the criterion are positive, that is, the relative 
standing of pupils on all these sets of questions in the 
open-book test is in the same direction as it is on the 
criterion test, but the extent of this relative standing 
differs from one set of questions to another. In other 
words the set of questions testing Knowledge in the open- 
book test is found to be least when correlated with the 
criterion, whereas the set of questions testing Application 
in the open-book examination bears a high correlation with 
the criterion in both the type of questions - multiple- 
choice and short-answer. This shows that in open-book tests 
more pupils of high group score high marks and more pupils 
of low group Score low marks on questions testing Application 
than in the case of other objectives. Although this method 
includes the scores of Middle group also, yet the results 
are the same when two types of questions - multiple-choice 
and short answer - are compared separately. 




Hence 


" In open-book examinations Questions of both - 

k 

Short-answer and multiple-choice type - testing i^ipllcatlon 
are most dlscriilnatlve." 



CHAPTEfi , V. 


^ISCU&SION, swmary op conclusions 
A im SUGGESTIONS. 


A. DISCUSSION 


The present study wss an attempt to find whether 
in an open-book examination 

(1) all pupils achieve equal marks on questions testing 
different objectives, 

(2) pupils of varying levels of ability score equal 
marks on questions testing the same objective, 

(3) questions testing different objectives are equally 
discriminative between good and poor pupils. 

On testing these hypotheses it was found that In 
an open-book examination 

1 , (a) In the case of multiple-choice type of ques¬ 

tions pupils Score higher marks on questions testing 
Knowledge or Understanding, but in the case of Application 
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It cannot be said so. 

The phenomenon also seems logical, because in 
questions testing Knowledge and to some extent Under¬ 
standing also, memory plays a significant part whereas 
critical thinking is tested almost in negligible propor¬ 
tion. But in open-book examinations both types of pupils - 
bright as well as weak - have equal opportunities to 
write the answer® with the help of books, hence on 
questions testing knowledge t and to some extent Under¬ 
standing also) both type of pupils are likely to score 
equally high marks. But in the case of questions testing 
Application It is not expected. In these questions the 
ability of critical thinking, applying the Knowledge in 
novel situations, solving problems etc Is tested which 
is least helped by books or notes etc. It seems, therefore, 
but natural that in an open-book examination one will 
score low marks on questions testing Application in 
comparison to other questions testing Knowledge or 
Understanding. 

1(b) in the case of short-answer type of questions 

pupils score high marks on questions testing Knowledge, 
but in the case of understanding, it cannot be said to be 
either high or low, whereas in the case of questions testing 
Application they score low marks. The same argument is 
true for this as was given in 1(a) above. 




AgalUj pupils score low marks on short-answer type 
of questions than on the multiple-choice type of questions. 
This too seems natural* just because guessing and copying 
are common phenomena associated with such (multiple-choice 
type etc.) tests and do operate in some measure inspite of 
the checks that we may plan and apply. 

It is also observed that pupils score lower marks 
on questions testing Application. This too seems natural; 
firstly beeause their preparation for the examination is 
according to the traditional examinations which do not 
emphasise the Questions testing Application* and secondly 
because the Questions testing Application require 
different study habits which these pupils have not 
acquired. 

2. Pupils with varying levels of ability score accord¬ 
ing to their ability only in the case of short-answer type 
of questions testing Application, In other cases there is 
at least one group which does not differ significantly from 
one or more groups. It is so because the multiple-choice 
type of questions suffer from more short-comings than 
short-answer type of questJons* and the questions testing 
the objectives of Knowledge and Understanding are adversely 
effected in multiple-choice type of questions because of 
these short-comings. 

3. Questions of both type (multiple-choice and short- 
answer type) testing Application are most dlBcrlmlnative, 
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Mult ip le-cholce type of questions testing Understanding and 
of the short-answer type testing Knowledge are least 
d i s c r Iniinat ive. 

In the case of short-answer type of questions It 
seems reasonable that questions testing Knowledge are 
least discriminative and questions testing Application 
most dlscrlminfitive, This is probably so because in an open 
book examination books give ready information and so help 
in solving questions requiring information whereas 
their availability does not help better scoring in regard 
to questions testing higher objective®. In this way It 
seems logical that the questions testing Application are 
most discriminative in the open-book examinations. 

But in the case of multiple-choice type of questions 
it is the set of questions testing understanding which Is 
least discriminative, which appears to be against the 
logical facts. But in the case of multiple-cholce type 
of questions one should not wonder if such things happen 
because some shortcomings are inherited only in fixed 
response type of questions. An.y-how, regarding multiple- 
choice type of questions it requires further experi¬ 
mentation* 

B. Summary of Conclusions ; 

The conclusions of the study derived may be 


summarised as below ■ 
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1. In an open-book 


In Mult Ip le -Cho 1 ee Type of 
quesHons pupils are very 
likely to score 

Ca) very high marks on 
questions testing Knowledge 
or Understanding 

Cb) not high (moderate) 
marks on auestions besting 
Application 

Cc) significantly lower 
marks on questions testing 
Application than on 
questions testing Know- 
-ledge or Understanding 

Cd) nearly equal (or negli¬ 
gibly different) marks on 
questions testing Knowledge 
or Understanding, 


2. In an open-book 

Mult Ip le -Cho ice type of 
questions testing 

^a) Knowledge the probabi¬ 
lity is .96 that pupils of 
High group will be discri¬ 
minated from the pupils of 
Middle as well as Low groups 
but it is very likely that 
the pupils of Middle and Low 
groups are not discriminated 
from each other* 


examination 


In Short -Answer type of questions 
pupTIi”are very likely to score 


(a) high marks on the questions 
testing Knowledge, 


(b) Moderate marks on questions 
testing understanding, 


(c) low marks on questjons 
testing Application. 


(d) Significantly lower marks 
on questions testing Applica¬ 
tion than on questions testing 
Knowledge or Understanding 


(e) significantly high marks 
on questions testing Knowledge 
than those testing Under¬ 
standing or Application. 

Hence, 

'•In an open-book examination in 
the case of short-answer type 
of questions the hierarchy of 
objectives - Knowledge, Under¬ 
standing and Application is 
confirmed." 


examination in the case of 

Short-Answer type of questions 
testing 

(a) I^owledge and Understanding , 
pupils of Sigh group will'score 
higher marks than those of 
Middle or Low groups, but it is 
very likely that pupils of 
Middle and Low groups are not 
differentiated from each 
other. 
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(b) Understanding, the proba¬ 
bility is .95 that the pupils 
of H group will score higher 
marks than those of Low group, 
but Low group is not discriminated 
either from Middle or High 
group. 

(c) Application, pupils of High 
group will score higher than 
those of Middle or Low group, 
but the Middle and the Low groups 
are not discriminated signifl- 
-cantly. 


(b) Application, pupils 
of High, Middle and Low 
groups are significantly 
discriminated frok each 
other. Thus 

Short-anewer type of 
questions testing Appli¬ 
cation are most discrimi¬ 
native in comparison to 
other objectives,” 


3. In an open-book 

the multiple-choice type 
of questions testing 

(a) U nderstanding are least 
disc'rimlna'tive 

(b) Application are most 
discriminative 


examination, 

the short-answer type of 
questions testing 

Knowledge are least 
d1s crImina^1ve 

(b) Application are most 
d 1 Sc Hmlna^ 1 viT 


The order in which the various forms of questions 
testing different objectives can be placed in order of their 
ability to discriminate between the pupils of High and Low 
groups based on Lawshe^s D Czu-zl) is shown in Table XXII. 
The same is also shown on the basis of 't'test in Table 
XXII. 


By comparing Table XXII and XXIII we find the same 
results. Thus the order in which the various forms of 
questions testing different objectives can be placed in order 
of their ability to discriminate between the pupils of High 
and Low groups is as follows i 
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lABie MO. nil. 


Types of Questions testing different objectives 
placed In order of their ability to discriminate 
on the basis of Lawshe’s D (zu-zl) 


S.No. 

Form of 
Question, 

Objective 

tested. 

Lawshe's D 
(zu-zl) 

Remarks 

1. 

Short 

Answer. 

Application 

4.835 

Most Dls- 
-crlminative 

2 • 

Short- 
Answer. 

Understanding. 

1.671 


3. 

Short 

Answer. 

Knwoledge 

1.396 


34. 

Multi- 

choice. 

Application 

.939 


5. 

Multi- 

Choice. 

Knowledge 

.377 


6. 

Multi- 

Choice. 

Understanding. 

.233 

Least discrl 
minative. 
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table- XXIIL 


Types of questions testing different objectives placed 
in order of their ability to discriminate on the basis 
of ‘t* test* 


s. 

No. 

Form of 
questions. 

Objective 

tested 

't' 

Remarks 

1. 

Short-Answer 

Application 

8.96 

Most discrimi¬ 





native. 

2. 

Short-Answer 

Understanding. 

7.U 


3. 

Short-Answer 

Knowledge 

6.63 


4. 

Hulti-'^hoice 

Application 

3.20 


5. 

Multi-Choice 

Knowledge 

2.16 


6, 

Multi-Choice 

Understanding 

1.64 

Least discrlml' 


native. 



S^ort-answer type of questions testing 
Application (most discriminative), 
ii) Short■answer type of questions testing 
Understanding . 

Ill) ^hort-answer type of questions testing 
Knowledge 

Iv) Mult ip leliia Cho ice type of questions testing 
Application. 

■v) Mult ip le-choi ce type of questions testing 
Knowledge, and 

MT^l^lplQ~cJ^ o lcQ type of questions testing 
UnderstandIng > (Least discriminative) 

C. SUGGESTIONS. 

As open-book examinations have many good qualities 
and in many respect they are found to be superior to the 
prevalent closed-book examinationsj for many defects of 
prevalent closed-book examinations are remedied, it Is, 
therefore suggested that 

(1) experimentation on open-book examinations should 
be undertaken intensively, 

(2) in some experimental schools, open-book 
examinations may be Introduced on experimental basis, 
and its effect may be studied so or to see its feasi¬ 
bility at University or Board Level, 
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(3) In these open-book examinations, short-answer type 

of questions testing Application should be set, because these 
are found to be most discriminative, 

D. SUGGESTIONS FOR FUHTHBR RESEARCH, 

The same study may be undertaken on different subjects 
for d life rent classes and It Inay be Investigated whether open- 
book examinations are suitable for all siobjects and for all 
classes at different levels, 

A slinllar study may also be undertaken on the open- 
book examJnations to study the pupil performance on all the 
objectives of cognitive domain as propounded by Bloom^namely 
Knowledge, Comprehension, Application, Analysis, Synthesis 
and Evaluation, 

The effect of open-book examination may also be studied 
by administering the same question paper Cor parallel question 
paper) In closed-book examination as well as In open-book 
examination, and in this way it may be studied that the pupils 
of what level of ability are benefltted most or least In the 
open book examination. 




1. Bloom, B,B« op.clt. 
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APPEWDIX-A. 

KEZ 

TO 

ABBREVIATIONS AND SYMBOLS USED IN THE REPORT. 


App. The 'Application* Objective. 

C, A Constant number. 

D Difference between Means. 

H The Upper group or High group. 

liS Highly significant, much beyond the level of ,01 

Kn, The 'Knowledge* objective, 

L. The 'Lower* group 

Lawshe's D or (zu-zl) 

Mean 

Mean Score on questions testing Application. 

Mean of X score® all multiplied by a constant C 
Mean Scores of High group 

Mean score of High group on questions testing 
Application 

Mean score of High group on questions testing Knowledge 

Mean score of High group on questions testing 
Understanding, 

Mean score on questions testing Knowledge. 

Mean score of Low group. 

Mean score of low group on questions testing 
'Application* 

Mean score of Low group on questions testing 
(* Knowledge*. 


M 
M 
M 

Mha 


a 


cx 


^hu 

% 

“l 

“la 

“He 
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Mean score of Low group on questions 
testing * Unde r st andIng' 

M,M. Maximum Marks, 

Mm Mean score of Middle group. 

^ma Mean score of Middle group on questions testing 

•Application' 

Hmk Mean Score of Middle group on questions testing 
'Knowledge' 

Mean score of Middle group on questions testing 
'Understanding' 

Mul.Choice or Multiple-choice type of questions. 
Multi-Choice. 


N 

NS 

P 


Pu 


ka 


ku 


‘ua 


xa 



Mean score on questions testing 'Undersfeanding* 

Mean score of raw scores 

Size of the sample or number of subjects inthe 
sample. 

Not significant, 

Propertlon of scores (marks obtained divided by maximum 
marks) 

p. of the upper group. 

Proportion of scores of the lower group. 

Coefficient of correlation 

Coefficient of Correlation between the scores on 
questions testing Knowledge and Application. 

Coefficient of Cor®elation between the scores on 
questions testing Knowledge and Understanding. 

Coefficient of Correlation between the scores on 
questions testing Understanding and Appliaatlon. 

Coefficient of correlation between the composite 
scores based on school tests and scores on 
questions testing Application 

Coefficient of Correlation between the composite 
scores based on school tests and scores on 
questions testing Knowledge. 
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Coefficient of correlation between the composite 
scores based on school tests and scores on cuestions 
testing Understanding* 

Short-answer type of questions, 

Standard Deviation of the scores when all the 
scores are multiplied by a constant C 

Standard Deviation, 

Standard Error. 

Student*s t* 

The Objective of Understanding, 

Varlanse s 

p In units of normal-curve deviate, 

In units of normal-curve deviate. 


The B.D. of raw scores. 




APPENDIX - B, 


7 


List of Schools from which the Data Is collected. 


(1) Governinent Boys* Higher Seoondary School 
Wo. 1, Sarojinl Wager, New Delhi. 

(2) Government Boys' Higher Secondary School, 
Wo. 3, Sarojlnl Wagar, New Delhi, 

and 

(3) Governinent Boys Higher Secondary School, 
Wo. 5, Sarojlnl Wagar, New Delhi. 




APPENDIX - G 


£>pecliiian. of the instructjons to students given 

one week before the administration of the Open-Book 

Test. 

Part-I consists of instruction in Hindi, and 
Part-II consists of instructions in English. 


Ends : - 

(i) Appendix *C' Part I 
Cii)Appendix Part II. 




APPENDIX 

{PART-D 
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^TTir EiV qr 5 |R ^ jTTOT M i¥ f?r xrft^rr 

^ ™ JI^Vt qr I I TfP5Tr ?Tr ^ TT 

^ ^ ^ Tfturr - ^ 

^ftijiT ^riRT Tflintf ^ ^ Mr ^ s?ff wStn fr 
^ 3?fT ^ fr JRT TfRTT??^ ^ TFT - ^ ^ 

^ POT ^ I 

ITT jr^FlT 7T^- - % SitS? ^^pf(*Trl 

^ jiFT-inr ^ M fr I 

JRFTFT ^ OT !■ iv OTt POTFIP} 

Tri^ if OTHTEp T^ff^ ^ jTjJr if Tfgfr (-^i^) ^ Tt ^ 
sffT 3 OT ^ i OT 37 ?!Tte ^ OT TT" 

' ^ ^rfm ' % m i 

I) vftm ^ Wr ^ % 

^?trqt, ^ w m ^ wi^ 3iTiV ot 
m m^ FIT? — Tfrm ^ ott ^rr^ ^ir ^ ^ 
TOfPT I 


2) TTT PflOT ^ W TrfT - TTtRT^ 




Jlii? ffJiHii ii-tnji h 
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APP3NDIX G an 

The syllabus for the test will be as follows : 

Stalght lines, Parallel Ijnes, Angles of triangles and 
quadrilaterals, Pythagoras Theorem, Medians of 
Trlangies, Lines Parallel to the base of the triangles, 
Theoretical questions on construction of triangles and 

quadrilaterals (Construction of Triangles and 

1 

Quadrilaterals will not be required). 

questions asked in the test will be similar to the 
following examplesi 

Write the serial letter of the correct answer 
of the following question : 

Q.l. The sujn of all the three interior angles of a 

triangle Is always 

(A) Greater than two right angles. 

B. Equal to two right angles. 

C. Less than two right angles, but 
greater than one right angle. 

D. Equal to one right angle. 

Answer £B) 

Q*2. Find the value of angles B,G and D of a parallelo¬ 
gram ABCD, if the value of angle A is 60° 

Ans: 

Because Angle C Is equal to Angle A (Opposite ^gles 

^ of a parallelogram) 

therefore Angle C « Is equal to 60 

Because the sum of angle A and Angle B is equal to 180 
(Adj ascent angles of a parallelogram) 
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the 2 *©rore angle B is equal to 180^-angle A 
or ISO^-GO*^ 
or liiO^ 

tJnereXorej angle D Is equal to A.ngle B 

or each of these angles is equal to 120° 

therefore the value of Angle B is 120° 

Angle C is 6o° 

and angle D is 120^ Answer. 
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_^PE NDIx - D. 


i>p0clinen ol the Question Paper for the Open Book Test, 


Enclosure ; 

1. Cyclo sty loci copy of the Open-Book Test 
In Geometry for Class - X. 



1 


^ingio = 34^ 
.-iD bisLc!:s 'mij:, 
FinJ the V'lJu-: ^ 



5rt. 


>DV' 


.^n thi; ‘’ ij \,y j, 1 ij.ifi 

P'’r!lLJrorM ;; 



t lit i i 


to CD, r. 

(iC 'I, PIVJ ijr, c,, 

through i‘, ii' 



1 ^ \ 


J 


f.< 


i 





Ends • 
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APPENDIX-E. 


Specimen of the Answer-Sheet for the 
Part-I of the Open Book Test, 


One Gyclostyled copy 
of the Answer-sheet for 
Part-I of the Open Book 
Te st. 
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AMSWER SHEET FOR PART - I 
of the Open-Book Examination 

.....,Class & Sec 

Name of the School..,,,., 

Subject - Mathematics -D (Geometry).,., Date,,,,,..,, 



TOTAL 
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appendix - P. 


List of Questions testing the Objectives of ’Knowledge* 

’Understanding', and ’Application’ in Part-I of the 
Open-Book Test, 


Objective. Question Numbers. 


1. Knowledge 1 , 3, 5, 7, 9, 14, 

25, 27 and 29 


Total No. of 
questions 
in each object. 


9 


2. Understanding. 2, 4, 6, 11, 12, 13, 

16, 17, 19, 21 and 23 


11 


3* Application 8, 10, 18 , 20 , 22 , 24, 

26, 28, and 30. 


9 


Note.- Question No. 16 was deleted. 
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APPEN DIX - G« 

List of Questjons testing the Objectives of 
Knowledge, 'Understanding’, and 'Application' 
in Part - II of the Open-Book Test. 

Objective Question HJujubers, Total No. of 

questions in 
each obje ctive 

1, Knowledge 31, 32 , 41, 43 , 45 

6 

and 46. 

2, Understanding 33, 35, 36, 37, 39 

6 

and 49 

3, Application 34 , 38 , 40 , 42 , 44 ^ 

and 48 and 50 


Notes - Question No. 47 was deleted* 
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^PENOIX - 

GLObS ARY OF TB GHMTf^AT. T ERNB, 

i’he technical tems used are being given with a brief 
explanation to give the interpretation of different terms 
followed in the study. 

Cl) APPLICATION; 

”Ari instructional or learning out-come involving the 

use of skillsj Knowledges, concepts and understandings In 

1 

practical pltuatlons," 

2 

"The ability to apply principles to new situations' 

3 

is described as to apply most directly to category Application. 

C2) BRIGHT AI'ID WEAiC PUPILS, or 

GOOD AI'ID POOR PUPILS, or 
High and Lov/ group, or 
Upper and Lower Group* 

"Students In the top 27 per cent on total test score 
are taken to be 'g@od' students, and those In the bottom 27 
per cent on total test score are taken to be 'poor' 
students."^ 


1. Greene, Harry A., Oorganson, Albert N., and Gerberlch, 

J. Raymond, Measurement and Evaluation In the b6condaiy_ 

Schools, New^York: Longman's, Green and Co., 1954, 

pi'SSo* 

2. American Council on Education Studies, " A Design for 
General Education.® as quoted in Bloom, op 

3. Bloom, op. clt ., p.48 

4. Ebe 1, R.L, .Measuring Educatlgna l^^^vemSS^* ^ 
Prentice-HaTTof India Prlste Ltd. 1966, p.301. 
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3. CHBaTING: 

Any flctlvjty of a student or group of students 

'vhOfae purpose Is to give any of them higher grades than they 

vjould be likely to receive on the basis of their own achleve- 

5 

ments In chfiatlng," e.g, copying from fellow-examinees' 
ansv.f3i‘S, uF.1ng books, cribs etc In the closed-book e 358 rainatlon. 

4. jLlitiED flOuK SXAfnNA'flONi Is a test In which exaniiness 
are not permitted to see books or notes etc in the examination 
t la 11« 


5. DIS'JHIMIWATION INDiSX, " is a measure of the extent e to 
which students who are judged to be good In terms of some 
standard succeed on the item and those who are judged to be poor 
on the same standard fall it. A commonly used index of 
dlscrllaination is simply the difference in a proportion of 
correct response between the group of those scoring in the top 
27 per cent on the total text and the group scoring in the 
bottom 27 per cent on the same test." 

6, UNUWLSDGIS. " A.n instructional or learning out-come 

represented by the ability to recall or recognise facts, 

7 

per eons, places or things" 


5, Ibid,, p. 209. 

6, Ibid ,, p. 349, 

7, Greene, Harry A, eb. al., P« 656 
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7. 0UJ3criVE. Behavioural goal, "aim, end In view, or 

purpose oi‘ coirse of action or a belief...u® 

8. Open Boor. Examination is a test in which examlntfeji 

are peralttod to consult book and notes etc in the examlnation- 
hnl] ?!xcapt tiiat they are not permitted to consult any person. 

9. UjiiDER." TAL'iDINUi. '* An instructional or learning outcome 
involving co./ip rehens ion of wha meaning and of the uses and 
slgnlf icMice of what has been hazx learned.”® 


8. Good, Carter V.Dlctioaary of Education, New Jorkj 
I'ic Graw-Hlll book Company Inc. 1959, second edition 

p .371. 

9, Greenfi, Harry ^A., et.al * p* 664. 




APPSMDIX-0. 


LI£iT OF JUDGES WHO JUDGED THE OBJ'ilCTIVHlS OP THE 
QUESTIONS OP THE OPEN-HOOK TEST. 


Prof, I.S^Chaudharl, 

Reader j Deptt, of Gurrioulim and Evaluation, 
National Institute of Education, 

New Delhi. 

Prof, H.S.Singha, 

Header, Deptt, of Ourrlculain and Evaluation, 
Natloail Institute of Education, New Delhi. 

Shri G.L.Ogra, Lecturer in Mathematics, 

at presentj student of 
As soelate ship Course, 


Shrl K.M.Umapati, 

-do- 

Shrl K.R.Prasad, 

-dO' 

Shrl M.M.Sharmaj 

-do 

Shri M.P.Panduranga, 

-do 




APPENDIX-K 


- 99 - 


Llst of scores of 180 pupils on their schools testsand on 
sets on questions testing separate objectives in the open 
-book test, ^ 


Stu- ^choo ^Achievement 
dent's xeit” Test""fist 
Code 123 
No. 

■^'50 60 15 

1 2 3 4 




^ Open-book Test 



MuIHpTe 

Choice 

Short“Answer 

Kn 

Un 

App 

in 

Un 

App 

9 

11 

9 

12 

12 

14 

5 



8 

9 

10 


1,01 

40 

38 

8 

6 

1.02 

25 

32 

0 

8 

1.03 

23 

38 

7 

6 

1.04 

21 

21 

2 

7 

1^05 

43 

48 

11 

9 

1.06 

20 

14 

5 

7 

1,07 

21 

37 

6 

3 

1.08 

36 

45 

7 

5 

1.09 

44 

50 

13 

7 

1.10 

33 

40 

5 

5 

1.11 

30 

39 

3 

8 

1.12 

22 

36 

8 

7 

1.13 

18 

17 

4 

6 

1.14 

15 

18 

4 

2 

1.15 

35 

38 

7 

4 

1.16 

38 

39 

5 

6 

1.17 

28 

35 

6 

7 

1.18 

41 

35 

10 

3 

1.19 

27 

23 

5 

8 

1.20 

31 

41 

7 

5 

1.21 

37 

46 

10 

7 


3 

7 

9 

9 

11 

7 
3 
11 
9 

11 

8 
6 
9 
6 

5 
8 
7 
11 

6 

7 

8 


4 8 3 

2 4 2 

4 9 1 

3 5 0 

7 10 12 

3 4 0 

17 5 

4 8 4 

3 10 11 

3 6 0 

2 0 0 

2 4 4 

4 4 0 

2 3 3 

2 4 6 

4 7 0 

3 7 2 

3 11 11 

2 11 6 

2 6 6 

6 9 7 


5 

4 

3 

3 

9 

2 

3 

4 
8 
2 
2 

5 
2 
0 
3 
2 
2 
8 
2 

8 


5 
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4 

5 

6 

7 

8 

■9 

10 

37 

4 

3 

5 

0 

8 

5 

5 

28 

4 

5 

5 

1 
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2 

33 

10 

7 

9 

4 

7 

4 

2 


10 

7 

9 

4 

10 

10 

10 

13 

4 

4 

9 

3 
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0 

36 

7 

5 

6 

2 

2 

0 

1 

37 

6 

5 

8 

3 

1 

0 

2 

42 

9 

5 

10 

6 

12 

7 

6 

28 

4 

6 

11 

4 

6 

0 

2 

42 

9 

5 

2 

3 

6 

2 

4 

57 

12 

9 

11 

7 

10 

12 

7 

26 

5 

6 

9 

4 

7 

5 

4 

20 

9 

5 

8 

3 

7 
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0 

46 

8 

7 

9 

4 

4 

6 

6 

40 

2 

5 

6 

2 

6 
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0 

26 

8 

9 

6 

4 

10 

12 

2 

62 

6 
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8 

3 

10 

04 

4 

27 

5 

8 

8 

3 

3 

6 

2 

44 

6 

4 

4 

2 

8 

5 

6 

34 

0 

7 

7 

3 

2 

0 

0 

24 

3 

5 

7 

3 

0 

0 

0 

10 

5 

5 

7 

3 

0 

0 

0 

23 

3 

6 

6 

3 

1 

0 

0 

35 

3 

4 

4 

2 

8 

4 

4 

40 

2 

5 

8 

2 

8 

0 

0 

28 

5 

8 

8 

3 

10 

3 

6 
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7 

a 

9 

5 

10 

5 
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6 
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7 
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8 

6 

7 

5 
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0 

45 

8 

6 

10 

4 

10 

6 

0 

41 

11 

6 

7 

5 

4 

7 

2 

41 

12 

8 

10 

5 

9 

12 

4 

36 

9 

4 

8 

4 

10 

6 

2 

39 

9 

8 

9 

4 

10 

10 

7 

33 

5 

5 

9 

3 

9 

6 

2 

47 

8 

5 

6 

7 

8 

10 

4 

16 

7 

7 

8 

5 

10 

8 

2 

31 

10 

7 

10 

4 

5 

7 

2 

55 

13 

8 

9 

5 

10 

12 

8 

24 

3 

7 

7 

4 

10 

7 

2 

25 

7 

5 

4 

4 

4 

1 

0 

19 

6 

6 

9 

4 

8 

4 

2 

31 

1 

7 

9 

7 

3 

4 

3 

8 

3 

5 

6 

2 

8 

2 

0 

33 

5 

8 

9 

4 

5 

6 

2 

41 

7 

4 

8 

7 

4 

10 

0 

18 

5 

6 

6 

2 

4 

4 

0 

27 

6 

5 

3 

6 

4 

3 

4 

9 

3 

6 

6 

3 

2 
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0 

12 

6 
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6 
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0 
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8 

9 

10 

9 

10 

12 
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9 
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9 

12 

12 

14 

2 

3 
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26 

55 

31 

_ 

6 

11 

6 

10 

10 

6 

11 

42 

38 

7 

6 

2 

8 

2 

4 

24 

39 

32 

7 

9 

5 

6 

4 

4 

12 

39 

38 

5 

5 

4 

6 

4 

2 

8 

14 

31 

5 

5 

4 

4 

1 

2 

8 

31 

19 

5 

6 

4 

6 

4 

2 

7 

22 
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4 

6 

5 

5 

4 

2 

6 

20 

17 

7 

8 

5 

5 

5 

0 
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26 

4 

5 

1 

6 
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0 

12 

30 

33 

5 

9 

4 

12 

8 

3 

IS 

44 

40 

5 

10 

6 

12 

8 

3 

16 

38 

30 

7 

10 

6 

11 

6 
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10 

5 
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7 
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1 

2 

4 

3 

10 

48 

27 

5 

2 

2 

1 

2 

0 

7 

44 

17 

4 

6 

3 

3 

4 
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12 

14 

3 


5 

6 

33^_ 

IUZZ 

mu 

II55I 

42 

23 

6 

3 

1 
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2 
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12 
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17 

21 

a 7 
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2 

4 
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4 
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2 
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30 

7 

10 

2 
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4 

6 

20 

13 

5 

9 

1 

6 

3 

2 

26 

29 

3 

8 

0 

6 

0 

4 

28 

19 

2 

5 

3 

6 

3 

2 

38 
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1 

6 

8 

2 

32 

10 
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3 

10 

3 
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23 

16 

3 

5 

1 

10 

2 

6 

33 

31 
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6 

2 

10 

5 

6 

17 

14 

5 

5 

1 

4 

4 

2 

43 

33 

5 

4 

4 

6 

4 

2 

39 

21 

8 

7 

3 

8 

4 

3 

13 

12 

5 

8 

1 

8 

7 

4 

66 

29 

6 

6 

0 

7 

8 

4 

20 

12 

6 

7 

1 

S 

10 

4 

30 

27 

6 

7 

1 

9 

10 

6 

12 

26 

3 

3 

1 

7 

3 

1 

35 

24 

5 

7 

1 

10 

6 

6 

61 

25 

7 

8 

3 

6 

7 

4 

18 

25 

5 

5 

2 

7 

4 

2 

44 

32 

5 
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4 

__5 

6 

J_' 

8 

I- J-- " 

10 

23 

30 

5 

3 

2 

7 

2 

2 

40 

39 

9 

9 

3 

10 

8 

4 

22 

13 

8 

6 

2 

12 

4 

1 

31 

21 

6 

6 

4 

8 

4 

0 

22 

19 

7 

6 

4 

10 

3 

2 

24 

28 

6 

7 

2 

12 

1 

2 

23 

27 

6 

3 

2 

8 

5 

2 

26 

8 

3 

3 

1 

8 

2 

2 

18 

19 

4 

3 

2 

2 

8 

2 

29 

19 

6 

2 

0 

2 

2 

4 

26 

27 

5 

7 

2 

6 

4 

4 

33 

23 

6 

5 

2 

8 

4 

2 

23 

21 

4 

3 

2 

6 

0 
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APPEND IX-L 

List oi Scores of pupils of 'L' groi:^ on 
the Open-book Test. 


c 

No. 

Code No. 

Composite 

scores. 



on Open 

Book 

Test 



Multi-choice. 

Short-Answer. 

Kn. 

Un. 

App. 

Kn. 

Un. 

App. 

1 

2 

3 

4 

5 

6 

7 

8 

9 

1. 

2.17 

-lj734 

7 

6 

1 

10 

6 

2 

2. 

1.23 

-1.773 

5 

5 

1 

4 

2 

2 

a. 

1.46 

-1.826 

6 

8 

2 

8 

0 

0 

4. 

2.41 

-1.B57 

4 

7 

1 

5 

2 

2 

5. 

3.34 

-1.90 

4 

3 

2 

2 

8 

2 

6 • 

3.17 

-1.92 

5 

8 

1 

3 

7 

4 

7. 

1.52 

-2.009 

6 

8 

1 

1 

0 

0 

8 • 

3.21 

-2.02 

3 

3 

1 

7 

3 

1 

9 . 

1.26 

-2.047 

4 

9 

3 

9 

0 

0 

m 

o 

1-1 

1.89 

-2.272 

5 

9 

3 

8 

4 

2 

11. 

3.07 

-2.28 

5 

9 

1 

6 

3 

2 

12. 

1.56 

-2.300 

7 

8 

4 

3 

2 

0 

13. 

1.02 

-2.306 

8 

7 

2 

4 

2 

4 

14. 

3.30 

-2.33 

7 

6 

4 

10 

3 

2 

15. 

1.64 

-2.356 

5 

3 

4 

2 

4 

2 

16. 

3.02 

-2.370 

6 

9 

4 

8 

6 

4 

17. 

1.37 

-2.371 

7 

7 

4 

10 

7 

2 

18; 

2.18 

-2.499 

7 

9 

4 

2 

6 

0 

19. 

1.06 

-2.607 

7 

7 

3 

4 

0 

2 

20* 

1.41 

-2.686 

7 

7 

3 

2 

0 

0 
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3 4 5 6 


-2.724 

6 

6 

3 

-2-757 

6 

7 

3 

-2.770 

8 

9 

6 

-2.776 

6 

7 

3 

-2,780 

5 

7 

5 

-2.780 

4 

8 

2 

-2.786 

6 

9 

4 

-2.831 

5 

9 

3 

-2.885 

7 

9 

3 

-2.888 

5 

7 

2 

-2.960 

5 

10 

4 

-2.971 

2 

6 

2 

-2.995 

5 

6 

1 

-3.177 

5 

7 

3 

—3.202 

5 

7 

3 

-3.26 

3 

3 

1 

-3.39 

B 

6 

2 

-3.459 

6 

2 

4 

-3.510 

4 

4 

4 1 

-3.577 

8 

10 

4 

-3.594 

7 

10 

5 

-3 .624 

7 

8 

5 

-3.630 

1 

4 

2 

-4.011 

4 

4 

2 

“4.07 

6 

5 

1 

—4.335 

4 

2 

1 


7 8 9 

10 0 
0 0 0 

5 4 0 

0 0 0 

3 3 0 

3 2 2 

4 0 2 

0 0 0 

3 0 3 

4 4^ 0 

2 2 0 

3 3 0 

4 4 0 

0 0 0 

0 0 0 

8 2 2 

12 4 1 

2 3 0 

2 0 0 

7 7 2 

7 6 0 

5 5 0 

3 10 

0 6 2 

4 4 

1 1 


2 

0 
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APPENDIX-M. 


List of scores of pupils of 'H' group 
on the Open-book Test, 


HompoilTe 

scores. 


6.269 

5.316 

5.812 

5.698 

5.485 

5.203 

5.18 

4.71 

4.524 

4.515 

4,401 

4.317 

4.115 

3.78 

3.743 

3.566 

3*392 

3.466 

3.37 

3.115 


_Marks on up e n ^io olV Test _ 

"Muli 1 - cHoTce. ” ^SFiorT-tSnswe r: 


Kn. 


8 

8 

9 

7 

7 

7 
5 
9 
9 

5 

6 

8 
6 
7 
5 
5 

a 

7 

7 

5 


Un 

9 

9 

11 

8 

9 

9 

6 

9 

11 

4 

11 

9 

7 

8 
2 

9 

10 
8 
10 
6 


App 


Kn. Un. App 


5 

5 

7 

5 

3 

4 
0 

3 
7 

4 

6 
3 

5 

3 

4 
3 

5 

6 
2 
7 


8 

10 

10 

12 

10 

10 

7 

10 

10 

6 

10 

8 
4 
6 
6 
3 
9 
9 
6 
8 


10 

12 

12 

12 

11 

10 

s 

8 

12 

4 

10 

8 

7 

7 

3 
6 

12 

7 

4 
10 


5 

8 

7 

10 

8 

10 

4 

4 

9 

2 

6 

3 
2 

4 
6 
2 
4 
8 
6 
4 





-Ill- 

3__ 

_4_ 

_5__ 


__7_8^^_ 

9 

2.946 

3 

4 

2 

7 4 

0 

2.936 

8 

8 

5 

6 4 

6 

2.868 

o 

10 

6 

12 7 

6 

2.827 

5 

10 

6 

12 8 

3 

2.813 

4 

7 

1 

7 4 

4 

2.724 

4 

4 

2 

7 4 

2 

2.673 

7 

9 

4 

4 6 

6 

2.421 

9 

10 

9 

10 12 

8 

2.374 

7 

9 

4 

7 4 

2 

2.359 

6 

3 

4 

8 3 

5 

2 .348 

8 

9 

4 

10 10 

7 

2.33 

5 

2 

3 

6 2 

4 

2.32 

8 

7 

3 

8 4 

3 

2 .24 

5 

4 

2 

7 2 

0 

2.237 

5 

11 

4 

8 4 

4 

2 -096 

4 

8 

4 

10 6 

2 

2.087 

6 

8 

2 

S 8 

4 

2.07 

6 

3 

1 

8 6 

2 

2 .059 

6 

7 

2 

8 6S 

5 

2.058 

3 

7 

3 

3 2 

2 

1.909 

7 

10 

5 

8 5 

4 

1.902 

2 

5 

2 

2 1 

2 

1.900 

7 

11 

3 

11 11 

8 

1.87 


6 

2 

10 5 

6 

1.867 

6 

7 

5 

9 11 

0 

1.86 

5 

7 

1 

10 6 

6 

1.70 

9 

10 

6 

6 7 

1 

1.649 

4 

3 

4 

5 4 

0 

1.626 

4 

3 

3 

3 2 

0 

1.620 

7 

9 

2 

9 10 

4 
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******** ^ 



